Skip to content

Conversation

@dbeltrankyl
Copy link
Collaborator

@dbeltrankyl dbeltrankyl commented Nov 21, 2025

Check List

  • I have read CONTRIBUTING.md.
  • Contains logically grouped changes (else tidy your branch by rebase).
  • Does not contain off-topic changes (use other PRs for other changes).
  • Applied any dependency changes to pyproject.toml.
  • Tests are included (or explain why tests are not needed).
  • Changelog entry included in CHANGELOG.md if this is a change that can affect users.
  • Documentation updated.
  • If this is a bug fix, PR should include a link to the issue (e.g. Closes #1234).

@dbeltrankyl dbeltrankyl changed the base branch from master to 2695-Completed_files November 21, 2025 11:34
@dbeltrankyl dbeltrankyl added this to the 4.1.16 milestone Nov 21, 2025
@dbeltrankyl dbeltrankyl self-assigned this Nov 21, 2025
@dbeltrankyl dbeltrankyl marked this pull request as draft November 21, 2025 11:35
@dbeltrankyl
Copy link
Collaborator Author

dbeltrankyl commented Nov 21, 2025

Hello, this is derived from #2700

Includes optimizations to the set_status:

  • During filtering
  • After filtering
  • Ready to review?

I decided to do it in a separate branch to make it easier to review.

Still a draft.

@dbeltrankyl
Copy link
Collaborator Author

I've changed the select_chunks to be much faster:

autosubmit -lc "DEBUG" setstatus a00r -fc "[ 20000101 [ fc0 [1-50000] ] ],JOB" -t COMPLETED -s -np

normal:

Chunk filtering took 5.19 seconds.

Optimized:

Filtering jobs with chunks [ 20000101 [ fc0 [1-5000] ] ],JOB
Chunk filtering took 0.01 seconds.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants